Rank probabilities for real random N x N x 2 tensors 
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Abstract 

We prove that the probability Pn for a real random Gaussian N x N x 2 tensor to be 
of real rank N is P N = (T((N + 1)/2)) N /G(N + 1), where r(x), G(x) denote the gamma 
and Barnes G-functions respectively. This is a rational number for N odd and a rational 
number multiplied by tt n / 2 for TV even. The probability to be of rank N + 1 is 1 — P^ ■ The 
proof makes use of recent results on the probability of having k real generalized eigenvalues 
for real random Gaussian N x N matrices. We also prove that log Pn = (iV 2 /4) log(e/4) + 
(log N — 1)/12 — C'( — 1) + 0(l/iV) for large N, where £ is the Riemann zeta function. 
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1 Introduction 

The (real) rank of a real mxnxp 3-tensor or 3-way array T is the well defined minimal possible 
value of r in an expansion 

r 

T=^u 4 ®v i ®w J (u,GM m ,v 1 eI n ,w I Gr) (1) 
i=l 

where denotes the tensor (or outer) product [U El HI [8] . 

If the elements of T are choosen randomly according to a continuous probability distribution, 
there is in general (for general m, n and p) no generic rank, i.e., a rank which occurs with 
probability 1. Ranks which occur with strictly positive probabilities are called typical ranks. We 
assume that all elements are independent and from a standard normal (Gaussian) distribution 
(mean 0, variance 1). Until now, the only analytically known probabilities for typical ranks were 
for 2 x 2 x 2 and 3x3x2 tensors [2J [7] . Thus in the 2x2x2 case the probability that r = 2 
is 7r/4 and the probability that r = 3isl — vr/4, while in the 3x3x2 case the probability of 
the rank equaling 3 is the same as the probability of it equaling 4 which is 1/2. Before these 
analytic results the first numerical simulations were performed by Kruskal in 1989, for 2x2x2 
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tensors [8], and the approximate values 0.79 and 0.21 obtained for the probability of ranks r = 2 
and r = 3 respectively. For N x N x 2 tensors ten Berge and Kiers [TD] have shown that the 
only typical ranks are N and N + 1. From ten Berge [9] , it follows that the probability P/v for 
an N x iV x 2 tensor to be of rank TV is equal to the probability that a pair of real random 
Gaussian N x N matrices T\ and T2 (the two slices of T) has iV real generalized eigenvalues, 
i.e., the probability that det(Ti — AT2) = has only real solutions A [21 [9]. Knowledge about the 
expected number of real solutions to det(Ti — AT2) = obtained by Edelman et al. [5] led to the 
analytical results for N = 2 and N = 3 in [2]. Forrester and Mays [7j have recently determined 
the probabilities pn,u that det(Ti — AT2) = has k real solutions, and we here apply the results 
to P/v = Pn,n to obtain explicit expressions for the probabilities for all typical ranks of N x N x 2 
tensors for arbitrary N, hence settling this open problem for tensor decompositions. We also 
determine the precise asymptotic decay of Pn for large TV" and give some recursion formulas for 
Pn- 



2 Probabilities for typical ranks of N x TV x 2 tensors 

As above, assume that T\ and T2 are real random Gaussian N x N matrices and let PN,k be the 
probability that det(Ti — AT2) = has k real solutions. Then Forrester and Mays |7| prove: 

Theorem 1. Introduce the generating function 

N 

Zn(0 = J2*^P^ ( 2 ) 

k=0 

where the asterisk indicates that the sum is over k values of the same parity as N . For N even 
we have 

N-2 

(_\\N(N-2)/8 V (N+l\N/2 V (N±2\N/2 2 

Zn(0 = — , : 2 J TT (fai + A), (3) 

Jvvs; 2 N ( N ~ l )/ 2 Y\ 1 r(|) 2 lo 

while for N odd 

rJV-l-i n V-3 

(-1)(N-1)(N-3)/8y(N±±)(N+1)/2y(N+1)(N-1)/2 I 4 I 1 2 

z »(0 = — oN(N-mn" rdv ' ^ ^ ( ^ a ' +A) ^ 

z llj=l L \2> 1=0 1 — 1 

(4) 

Here 

a l = Tr 1 77 7777VT27 ( 5 ) 



jv — i — 4Z r(^ s 



and 



T/ie expressions for f3i and are given in /7/ ; but are not needed here, and [•] denotes the 

ceiling function. 
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The method used in [7] relies on first obtaining the explicit form of the element probability 
density function for 

G = Tf X T 2 . (7) 

A real Schur decomposition is used to introduce k real and (N — k)/2 complex eigenvalues, with 
the imaginary part of the latter required to be positive (the remaining (N — k)/2 eigenvalues 
are the complex conjugate of these), for k = 0, 2, . . . , iV (N even) and k = 1, 3, . . . , iV (N odd). 
The variables not depending on the eigenvalues can be integrated out to give the eigenvalue 
probability density function, in the event that there are k real eigenvalues. And integrating this 
over all allowed values of the real and positive imaginary part complex eigenvalues gives P/\rfc. 
Prom Theorem [1] we derive our main result: 

Theorem 2. Let P/v denote the probability that a real N x N x 2 tensor whose elements are 
independent and normally distributed with mean and variance 1 has rank N . We have 

(T((N + l)/2)) N 
Pn = G(N + 1) ' (8) 

where 

G(N + 1) := (N- l)!(JV-2)!...l! (N € Z + ) (9) 

is the Barnes G-function and T(x) denotes the gamma function. More explicitly P 2 = 7r/4, and 
for N > 4 even 

nN/2 ( N _ -QiV-1 ( N _ 3) iV-3 . .38 



N 



(10) 



2^ 2 /2(Ar_2)2(Ar_4)4..... 2 ^-2 ' 
while for N odd 

(JV-l)"-i(JV-3)"-3.....2 2 
N 2 JV ( iV " 1 )/ 2 (N- 2) 2 (iV-4) 4 -...- 3^- 3 ' 1 ' 

Hence P/v for N odd is a rational number but for N even it is a rational number multiplied by 
ix N l 2 . The probability for rank N + 1 is 1 — P/v. 

Proof. From [2] we know that P/v = Pn,n- Hence, by Theorem [1] 



Pn=Pn,n = t ^^ w Z n (0 (12) 



Since 



and 



Y-2 V-2 

1 d N 2 2 

M^n(^+A)=n«« ( i3 ) 
s 1=0 1=0 

r tt-l i i y-3 r N-1 -, -1 Y-:i 

1 d N J 1 '■- 



Nl d£ N 



z n k% + Pi) n (£ 2 «m/2 + A+1/2) = n n a ^ ^ 

1=0 pjv-i-i *=0 ^ 



the values of fi\ and A+1/2 are n °t needed for the determination of P/v- By ([3]) we immediately 
find 



N-2 
2 



/ 1 ^(Af-2)/8p^ A r +l -|jV/2r;(- A f +2 -|jV/2 
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if N is even. For N odd we use (j3J) to get 



( 1 yAf-l)(Af-3)/8p(- A f +l ^('Af+l)/2p(- A r +2 -|(Af-l)/2 I 4_^| 1 

2 jv(jv-i)/2 n^rd) 2 



JV-3 
2 



= o^-n/miv xv.n 2 2 * II °i II «W/2 (16) 

1=0 ^ 



Substituting the expressions for a/ and a/ +1 / 2 into these formulas we obtain, after simplifying, 
for N even 



N-2 



3 _ ( _ 1)j v( j v-2)/8 (27r)j y/2 r(j m )j v » i 

w 2 Ar ( Af - 1 )/ 2 TT -1 T(i) 2 y N - 1 - 4Z ' [ ' 



and for N odd 



r jv-i i 1 v-3 

_ (_i)(JV-i)(JV-3)/8 (27r) (JV+i)/2 r( JVii)JV l-r-l ! "HI ! 

PjV ~~ oMAf-iV2+i rr^v Tvi\2 11 N — 1 - 4/ H TV - 3 - 4Z ' ( ' 18 ' ) 



Now 



2 JV(iv-i)/2+i TT^ 1 rfi)2 11 at- 1-4/ 11 jV-3-4Z 

1 1.7 = 1 ^ ^ 2 ^ 1=0 |-JV=ll 



n r ^/2) a = rpr+iw j5 r0 ' /2)r(0 ' + 1)/2) 



r((iv + i)/2)ii 

T((iV + l)/2) Z * ^ v+ ^' 



(19) 



where to obtain the second equality use has been made of the duplication formula for the gamma 
function, and to obtain the third equality the expression (J9j) for the Barnes G-function has been 
used. Furthermore, for each N even 

(N-2)/2 i \JVW-2)/8 

(_!)iV(JV-2)/8 Yl { ~ ' 



N-l-41 (N -1)(N - 5) ...(N -1- (2N - 4)) 

1 



(N — 1)(N — 3) ... 3 • 1 

r(i/2) 



(20) 



2 N / 2 T((N + l)/2)' 

where to obtain the final equation use is made of the fundamental gamma function recurrence 

r(x + l) =xT(x), (21) 
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and for N odd 



JN-l)(N-3)/8 



1 



1 



II jv _ | _ 1/ xi A" - - 1/ 

1=0 pAzil 



JV-3 
2 

n 



(_-Q(iV-l)(iV-3)/8 , 



1 



1 



(iV - 1)(N - 5) ... 2 (-4)(-8) . (-iV + 3) 
I (iV - l)(jV - 5) ... 4 (-2)(-6) . . . (-N + 3) 



, AT = 3,7,11,... 
, N = 5,9,13,... 



1 



(N- l)(7V-3)...4-2 
1 

2(JV-i)/2r((JV + l)/2) 



(22) 



Substituting (USD and ([20 ]) in ([17]) establishes © for TV even, while the TV odd case of © 
follows by substituting (fl"9]) and ([22]) in ([15]). and the fact that 

T(l/2) = (23) 

The forms (|10|) and ([lip follow from ([8]) upon use of ([9]), the recurrence (|21 j) and (for N even) 

□ 



3 Recursion formulas and asymptotic decay 

By Theorem [2] it is straightforward to calculate Pm+i/Pn from either ([8]) or (jlOp and (jlip . and 
P n+2 /Pn from either (JSJ) or (JTDJ and (TTT]). 

Corollary 3. For general N 

_ t(n/2 + i) N+1 i _ ((jv + ^^rqiv + i)^) 2 

Ptf+i-JV- r((JV + 1)/2)JV r(iv + i)' ^+2-^ r(iv + 2)r(iv + i) (24) 



More explicitly, making use of the double factorial 

Nil = 



N(N - 2) ... 4 • 2, N even 
N(N - 2) ... 3 • 1, N odd, 

for N even we have the recursion formulas 

{N\\) N 7T (N + 1) N+1 

P N+1 - P N ■ ^ N /2^ N _ 1 y^N+i ' Pn + 2 - Pn ■ 2 ' 2 2N + 1 (N\\) 2 (25) 
and for N odd we have 

vr( 7V+1 )/ 2 (iV!!) JV (iV + l)^ 1 

P^v+i - Ptv • 2 (3JV+i)/2(( iV _ 1 ) !! )JV+i ' Pn + 2 ~ Pn " 2 2iV+i(jv!!)2- (26) 
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We can illustrate the pattern for Pjy using Theorem [2] or Corollary [3j One finds 



^1 ^ 2 P - 1 

— 2 10 3 2 
5 5 -3 3 3 „ 3 2 



P 6 - 226 • 7T , i* ( - 5 2 . 2 5 

7 7 • 5 5 • 3 4 2 4 

-PR = TTT^ ' 7T , Pq 



2 48 ' y 7 2 . 5 4 

7 7 -5 5 -3 17 = „ 5 
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280 ' 11 74 . 36 . 25 

ll 11 • 7 7 • 5 5 • 3 15 5 2 

P 12 = glM 7T 6 , A3 = U 2 . 76 . 2 4 ' ' ' ^ 

Numerically, it is clear that P/v — > as N — > 00. Some qualitative insight into the rate of 
decay can be obtained by recalling Pn = Pn,n and considering the behaviour of PN,k as a 
function of k. Thus we know from [5] that for large N, the mean number of real eigenvalues 
En := {k) PN k is to leading order equal to ^/ttN/2, and from [7] that the corresponding variance 
a N := (k 2 ) PNk — Efj is to leading order equal to (2 — \/2)En- The latter reference also shows 
that limjv->oo &nPn,[ct n x+e n } = ~j^ e ~ X ^ ! > anc ^ ^ s * nus P^.fc * s a standard Gaussian distribution 
after centering and scaling in k by appropriate multiples of y/N. It follows that pn,n is, for 
large N, in the large deviation regime of PN,k- We remark that this is similarly true of Pn,N i n 
the case of eigenvalues of N x N real random Gaussian matrices (i.e. the individual matrices 
Ti, T 2 of ©), for which it is known p N ,N = 2" Ar ( Ar - 1 )/ 4 [5], Section 15.10]. 

In fact from the exact expression ([5D the explicit asymptotic large N form of Pn can readily 
be calculated. For this, let 

A = e -C(-i)+i/i2 _ 1.28242712... (28) 
denote the Glaisher-Kinkelin constant, where £ is the Riemann zeta function [llj. 
Theorem 4. For large N , 

P N = Ari/i2 ( |)^ 2 /4 . Ae -V*(i + O^" 1 )) (29) 

or equivalently 

log Pat = (N 2 /A) log(e/4) + (log JV _ i)/i 2 - ('(-l) + 0(l/iV). (30) 

Proof. We require the x — > 00 asymptotic expansions of the Barnes G-function [12] and the 
gamma function 

logG(x + 1) = ^-logx - -x 2 + Jlog2vr - ^- logx + C'(-l) + o(-Y (31) 



4 2 12 ' v ' \x 

r (l + i) = v£(3'(i + l t oQ) (32) 



6 



For future purposes, we note that a corollary of (J32J), and the elementary large x expansion 



1 + f)"-< 1 -s +0 (?)) 



is the asymptotic formula 



To make use of these expansions, we rewrite ([S]) as 

_ (r(jv/2 + i)) JV / r((iv + i)/2) ^ 
^- G (jv + i) lr(iv/2 + i)J • (35j 

Now, (|34p and (|33p show that with 

y := AT/2 (36) 

and y large we have 

Furthermore, in the notation (|36|) it follows from (|31|) and (|32|) and further use of (|33|) (only the 
explicit form of the leading term is now required) that 



T(N/2 + 1)^ 

- e 



■y 2 log(4/ e ) e ylogy+^ l og a» e l/6-f'(-l) ^ + ()(-)) . (38) 



G(N + 1) 

Multiplying together ([3"7]) and ([3^]) as required by ([33]) and recalling ([55]) gives 

Recalling ([581) : the second stated result (f30[) is then immediate. □ 



Corollary 5. For large N , 

-Pv-i-1 /e\( 2Ar + 1 )/ 4 
N+1 - ' V (l + CKAT- 1 )) (39) 



This corollary follows trivially from Theorem 01 It can however also be derived directly from 
the recursion formulas in Corollary [21 without use of Theorem [H 
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